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REMARKS 

Request for Reconsideration, Informal Matters. Claims Fending 

The non-final Office Action mailed on 10 June 2005 has been 
considered ceirefully. Reconsideration of the claimed invention in view of the 
amendments above and the discussion below is respectfully requested. 

The Applicants respectfully decline to include a summary in the 
specification. 

Claims 1-37 are pending. 

Allovyabilitv of Claims Over Rigopulos & Hruska 



Rejection Summary 

Claims 1-29 and 34^6 stand rejected under 35 USC 103(a) as being 
unpatentable over U.S, Patent No. 5,763,804 (Rigopulos) in view of U.S. 
Publication No, 2001/017415 (Hruska). Office Action, 10 June 2005, para. 3. 



Allowability of Claim 1 



Regarding Claim 1, contrary to the Examiner's assertion, 
Rigopulos and Hruska fail to disclose or suggest an 



, . . method for creating a polyphonic audio mix on a handheld mobile 
wireless communication device having a soundtrack data set file stored 
thereon, comprising: 
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entering first reference data for a first soundtrack of the soundtrack 
data set file into an audio mix data reference file by selecting the first 
soundtrack/ 

entering second reference data for a second soundtrack of the 
soundtrack data set file into the audio mix data reference file by selecting the 
second soundtrack, 

the audio mix data reference file having the first and second reference 
data representative of a user defined polyphonic audio mix; 

storing the audio mix data reference file having the first and second 
reference data on the handheld mobile wireless communication device 
separately from the soundtrack data set file* 

The Examiner's references to various passages of Rigopulos do 
not support the assertion that Rigopulos discloses the limitations of Claim 1. 
Particularly, Rigopulos does not enter first and second reference data for first 
and second soimdtracks into an audio mix data reference. Rigopulos discloses 
a music synthesizer on a personal computer wherein a user creates music by 
operating a joystick or other input device. At col. 8, lines 35-58, Rigopulos 
discloses selecting a backgroimd track that is played while operating the input 
device. After selecting the background track, the user in Rigopulos is allowed 
to select a musical instrument. Rigopulos, col. 8, line 65 - coL 9, line 12. In 
Rigopulos, there is no discussion of entering reference data from the selected 
background track into a reference file. Rigopulos also fails to disclose storing a 
reference file having the first and second reference data separately from a 
soundtrack data set file from which the first and second soundtrack were 
selected. In Rigopulos, the background track is either loaded into memory for 
play or streamed from a hard drive. The Examiner relies on Piruska for 
teaching a handheld mobile device having an audio mixer, but Hruska also 
fails to disclose or suggest the limitations discussed above. Claim 1 is thus 
patentably distinguished over Rigopulos and Hruska. 
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Allowability of aaim 2 

Regarding Claim 2, Rigopulos and Hruska fail to disclose or 
su ggest in combination with Qaim 1 

... entering first time data associated with the first reference data into the 
audio mix data reference file, entering second time data associated with the 
second reference data Into the audio mix data reference file. 

At col. 3, lines 5*11 (referenced by the Examiner), Rigopulos 
discusses the storage of background tracks and rhythm blocks containing note 
duration notes on a media storage device. As noted, Rigopulos does not create 
an "audio mix data reference file" into which time data is entered. Claim 2 is 
thus further patentably distinguished over the art. 

AUowability of Claim 3 

Regarding Claim 3, Rigopulos and Hruska fail to disclose or 
suggest in combination with Claim 1 

... entering tempo data associated with the user defined polyphonic audio mix 
Into the audio mix data reference file. 

While the background tracks of Rigopolus contain a tempo track, there is no 
disclosure in Rigopolus of entering tempo data in an audio mix data reference 
file. Claim 3 is thus further patentably distinguished over the art. 

Allowability of Claim 4 
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Regarding aaim 4, Rigopulos and Hruska fail to disclose or 
suggest in combinatiOTi with Claim 1 

... entering reference soundtrack data into the audio mix data reference file. 

Rigoptdos does not enter soundtrack data into a reference file. Qaitn 4 is thus 
further patentably distinguished over the art 

Allowability of Claim 5 

Regarding Claim 5, Rigopulos and Hruska fail to disclose or 
suggest in combination with Claim 1 

. entering the first reference data by selecting the first soundtrack, 
entering second reference data by selecting the second soundtrack 

while the first soundtrack is playing 

playing the second soundtrack with the first soundtrack after selecting 

the second soundtrack. 

At coL 8, lines 40-50, Rigopolus merely discusses a setup stage during which a 
user selects a backgroxmd track, which is played while creating music with the 
joystick. Rigopolus does not disclose playing first and second soimdtracks 
upon selecting a second soundtrack while playing a first soundtrack. Claim 5 
is thus further patentably distinguished over the art. 

Allowability of Claim 6 
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Regarding Qaim 6, Rigopulos and Hnxska fail to disclose or 

suggest in combination with Claim 1 

... entering the first reference data by selecting the first soundtrack, 
entering first effect reference data for a first soundtrack effect of the 

soundtrack data set file by selecting the first sotmdtrack effect while the first 

soundtrack is playing, 

playing the first soundtrack effect with the first soundtrack upon 

selecting the first soundtrack effect, 

Rigopolus does not disclose playing first and second soundtracks upon 
selecting a second soundtrack while playing a first soundtrack. Claim 5 is thus 
further patentably distinguished over the art, 

AUowabilitv of Claim 7 

Regarding Claim 7, Rigopulos and Hruska fail to disclose or 
suggest in combination with Claim 1 

integrating the audio mix data reference file and the soundtrack data set 
file into a common audio format file. 

Rigopolus does not disclose generating an "audio mix data reference file" and 
thus there is no reason for Rigopolus to integrate a reference file and a data set 
file into a common format. None of the passages of Rigopolus referenced by 
the Examiner disclose or suggest generating an audio mix data reference file. 
Claim 7 is thus further patentably distinguished over the art. 

Allowability of Claim 8 
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Regarding Qaim 8, Rigopulos and Hruska fail to disclose or 
suggest in combination with Oaim 1 

irreversibly integrating the audio mix data reference fUe and the 
soundtrack data set file into a common audio format file. 

Rigopolus does not disclose an ''audio mix data reference file" and thus there 
is no reason for Rigopolus to irreversibly integrate a reference file and a data 
set file into a common format. None of the passages of Rigopolus referenced 
by the Examiner disclose or suggest generating an audio mix data reference 
file. Qaim 8 is thus further patentably distinguished over the art. 

Allowability of Claim 9 

Regarding Qaim 9, Rigoptilos and Hruska fail to disclose or 
suggest in combination with Qaim 1 

playing the user defined polyphonic audio mix on the handheld 
mobile wireless communication device by playing the first and second 
soundtracks of the soundtrack data set file referenced by the first and 
second reference data in the audio mix data reference file, 

Rigopolus does not disclose an "audio mix data reference file" and thus 
Rigopolus cannot play an audio mix iising an audio mix reference file. None of 
the passages of Rigopolus referenced by the Examiner disclose or suggest 
generating an audio mix data reference file. Claim 9 is thus further patentably 
distinguished over the art. 

Allowability of Claim 10 
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Regarding Claim 10/ contrary to the Exannixier's assertion, 

Rigopulos and Hruska fail to disclose or suggest an 

ixiethod for playing a polyphonic audio mix on a handheld mobile 
wireless communication device having a soundtrack data set file stored 
thereon^ comprising: 

playing a first soundtrack of the soundtrack data set file referenced in 
an audio mix data reference file, 

pla3ring a second soundtrack of the soundtrack data set 61e referenced 
in the audio mix data reference file/ 

the audio mix audio file devoid of soundtrack data of the soundtrack 
data set file, 

the audio mix audio file stored separately from the soundtrack data set 
file on the handheld mobile wireless commxmication device. 



Rigopolus does not disclose playing soimdtracks referenced in a 
reference file. Rigoplous discloses generating mtisic using a joystick or other 
input device in which the user can control the notes played and pitch of a 
selected instrument with an accompaniment (background track). Rigoplous 
does not disclose an audio mix audio file devoid of soundtrack data. The 
Examiner relies on Hruska for teaching a handheld mobile device having an 
audio mixer, but Hruska also fails to disclose or suggest the limitations 
discussed above. Claim 10 is thus patentably distinguished over the art. 



Allowability of Claim 11 



Regarding Claim 11, Rigopulos and Hruska fail to disclose or 
suggest in combination with Claim 10 



... playing the first and second soundtracks at times specified by the audio 
mix data reference file. 
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At coL 7, lines 50-51 (referenced by the Examiner)^ Rigoploxis discloses playing 
the melody upon depressing a button on the joystick^ not based on times 
specified by a reference file. Claim 11 is thus further patentably distinguished 
over the art. 

Allowability of Claim 12 

Regarding Claim 12, Rigopulos and Hriiska fail to disclose or 
suggest in combination with Claim 10 

... playing the user defined polyphonic audio mix on the handheld mobile 
wireless conunimlcation device at a tempo specified by the audio mix data 
reference file. 

At col 9, lines 29-33, Rigoplous discloses modifjdng a defatilt playing style of 
the selected background track. The backgroimd track of Rigopolus is not a 
polyphonic audio mix since it contains ordy a single track. Claim 12 is thus 
ftirther patentably distinguished over the art 

Allowability of Claim 13 

Regarding Claim 13^ Rigopulos and Hruska fail to disclose or 
suggest in combination with Claim 10 

... irreversibly integrating the audio mix data reference file and the 
soundtrack data set file into a common audio format file. 
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Rigopolus does not disclose an "audio mix data reference file" and thus there 
is no reason for Rigopolus to irreversibly integrate such a reference file and a 
data set file into a common format None of the passages of Rigopolus 
referenced by the Examiner disclose or suggest generating an audio mix data 
reference file. Claim 13 is thus further patentably distinguished over the art. 



AUowabilitv of Claim 14 



Regarding Qaim 14 contrary to the Examiner's assertion, 
Rigopulos and Hruska foil to disclose or suggest an 



... method for a polyphonic audio mix on a handheld mobile wireless 
communication device having a soundtrack data set file and an audio mix 
data reference file stored separately thereon, comprising: 

integrating the audio mix data reference file and the soundtrack data 
set file into a common audio format file, 

the audio mix data reference file having first and second soundtrack 
reference data referencing first and second soundtracks of the soundtrack data 
set file, 

the audio mix data reference Hie devoid of soundtrack data from the 
soundtrack data set file; 

uploading the common audio format file from the handheld mobile 
wireless communication devlce. 



Rigopolus does not disclose an "audio mix data reference file" and thus there 
is no reason for Rigopolus to integrate such a reference file and a sotmdtrack 
data set file into a common audio file format and uploading the common 
audio format file. None of the passages of RigopK>lus referenced by the 
Examiner disclose or suggest generating an audio mix data reference file. The 
Examiner relies on Hruska for teaching a handheld mobile device having an 
audio mixer, but Hruska also fails to disclose or suggest the limitations 
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discussed above. Claim 14 is thus further patentably distinguished over the 
art 

Allowability of aaim 15 

Regarding Claim 15, Rigopulos and Hruska fail to disclose or 
suggest in combination with Claim 14 

... irreversibly integrating the audio mix data reference file and the 
soundtrack data set file into the common audio format file. 

At col. 19, lines 15-21 (referenced by the Examiner), Rigoplous discusses 
saving the users performance on a hard drive. However, Rigopolus does not 
disclose an ^audio mix data reference file'" and thus there is no reason for 
Rigopolus to irreversibly integrate a reference file and a data set file into a 
common format. None of the passages of Rigopolus referenced by the 
Examiner disclose or suggest generating an audio mix data reference file. 
Claim 15 is thus further patentably distinguished over the sirt. 

Allowability of Claim 16 

Regarding Claim 16, Rigopulos and Hruska fail to disclose or 
suggest in combination with Claim 14 

... before integrating, creating the audio mix data by entering first reference 
data for the fLrst soundtrack into the audio mix data reference file and by 
entering second reference data for the second soundtrack Into the audio mix 
data reference file. 
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Since Rigopolus does not disclose a reference file or integrating the reference 
file with a sovindtrack data set file, there is no reason for Rigopolus to create 
audio mix data by entering reference data into a reference file. Claim 16 is 
tlius further patentably distinguished over the art. 

Allowability of Claim 17 

Regarding Claim 17, Rigopulos and Hruska fail to disclose or 
suggest in combination with Claim 16 

entering corresponding time data associated with the first and second 
reference data into the audio mix data reference file. 

At col. 3, lines 5-11 (referenced by the Examiner), Rigopulos 
discusses the storage of backgroimd tracks and rhythm blocks containing note 
duration notes on a media storage device. As noted, Rigopulos does not create 
an "audio mix data reference file" into which time data is entered. Claim 17 is 
thus further patentably distinguished over the art. 

Allowability of Claim 18 

Regarding Claim 18, contrary to the Examiner's assertion, 
Rigopulos and Hruska fail to disclose or suggest an 



... method for a polyphonic audio mix on a handheld mobile wireless 
communication device, comprising: 
selecting a first soundtrack; 

playing the first sotmdtrack upon selecting the first soundtrack; 
selecting a second soundtrack while playing the first soundtrack; 
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playing the second soundtrack upon selecting the second soundtrack 
while playing the first soundtrack. 

Rigolopus does not play the first soundtrack (backgroiwid track) 
upon selecting it. In Rigolopus, the background track is selected in the setup 
stage (col. 8, lines 43-59) but not played until the joystick START button is 
depressed (col, 9, lines 33-39). After the setup is complete, the user selects an 
instrument. CoL 8^ lines 66-67. In Rigopolus, however, music is not created 
using the instrument until the user depresses the PLAY button on the joystick. 
Thus Rigopolus does not play the second sovuidtrack upon selecting the 
second soundtrack. The Examiner relies on Hruska for teaching a handheld 
mobile device having an audio mixer, but Hruska also fails to disclose or 
suggest the limitations discussed above. Claim 18 is thus patentably 
distinguished over the art. 

Allowability of aaim 19 

Regarding Claim 19, Rigopulos and Hruska fail to disclose or 
suggest in combination with Claim 18 



... a soundtrack data set file including the first and second soundtracks 
stored on the handheld mobile wireless communication device, 

entering first reference data for the first soundtrack of the soundtrack 
data set file into an audio mix data reference file upon selecting the first 
soundtrack, 

entering second reference data for the second soundtrack of the 
soundtrack data set file into the audio mix data reference file upon selecting 
the second soundtrack, 

the audio mix data reference file representative of a user defined 
polyphonic audio mix; 

storing the audio mix data reference file on the handheld mobile 
wireless communication device. 
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Rigopolus does not disclose or suggest generating or storing 
"audio mix reference file/' Claim 19 is thus further patentably distinguished 
over the art. 



AllowabUity of Claim 20 

Regarding Claim 20, Rigopulos and Hruska fail to disclose or 
suggest in combination with Claim 19 

... playing the user defined polyphonic audio mix on the handheld mobile 
wireless communication device by playing the first and second soundtracks of 
the soundtrack data set file referenced in the audio mix data reference file, 

Rigopolus does not disclose or suggest an "audio mix reference 
file" and thus Rigopolus does not suggest playing a polyphonic audio mix by 
playing soundtracks referenced on an audio mix data reference file. Claim 20 
is thus further patentably distinguished over the art. 

Allowability of Claim 23 

Regarding Claim 23, Rigopulos and Hruska fail to disclose or 
suggest in combination with Oaim 22 

... selecting at least one subsequent soimdtrack after selecting the reference 
soundtrack while the reference soundtrack is playing, mixing the at least one 
subsequent soundtrack selected with the reference soundtrack upon selecting 
the subsequent soundtrack. 
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Rigoplous does not mix upon selecting. As noted^ Rigopolus mixes upon 
pressing the START and PLAY buttons on the joystick after selecting. Claim 
23 is thus further patentably distinguished over the art. 

Allowability of Claim 28 

Regarding Claim 23, Rigopulos and Hruska fail to disclose or 
suggest in combination with Claim 18 

. . . selecting a global audio characteristic common to all selected soundtracks 
while playing the selected soundtracks for which the global audio 
characteristic is selected/ changing the audio characteristic of ail selected 
soundtracks while the soundtracks are playing upon selcx:ting the global 
audio characteristic. 

Rigopolus only controls characteristics of the ir\strument using the joystick. 
The characteristic of the background soundtrack can only be changed pressing 
the START button. Claim 28 is thus further patentably distinguished over the 
art. 

Allowability of Claim 34 

Regarding Claim 34, contrary to the Examiner's assertion, 
Rigopulos and Hruska fail to disclose or suggest a 



. . . method for creating a polyphonic audio mix on a handheld mobile 
wireless communication device, comprising: 

sc^lecting a first soundtrack having a first time interval; 
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seiecting a second sotindtrack having a second time interval^ the 
second time interval different than the first time interval; 
mixing the first and second soundtracks. 

Rigopolus controls the time interval when mixing, i.e., by depressing the 
PLAY button while the accompaniment (background track) is playing. The 
backgroimd track in Rigopolus has no time interval associated therewith. The 
user controls the playing of the background track by depressing the START 
button. The time interval of the instrument depends on how long the user 
depresses the PLAY button. Thus the first and second soundtracks of 
Rigopolus do not have associated different time intervals. The Examiner relies 
on Hruska for teaching a handheld mobile device having an audio mixer, but 
Hruska also fails to disclose or suggest the limitations discussed above. Claim 
34 is thus patentably distinguished over the art. 

Allowability of Claiiii 35 

Regarding Claim 36 Rigopulos and Hruska fail to disclose or 
suggest in combination with Claim 34 

saving an audio mix reference file corresponding to a polyphonic audio 
mix, the audio mix reference file referencing tihe first and second soundtracks 
stored in a separate file, playing the polyphonic audio mix by referencing the 
first and second soundtracks with the audio mix reference file. 

Rigopolus does not disclose saving an audio mix reference file that is stored 
separately from soundtracks referenced in the reference file. Oaims 36 is thus 
further patentably distinguished over the art. 
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Allowability of Claims Over Rigopulos, Hruska & Furukawa 

Rejection Sximmarv 

Claims 30-33 and 37 stand rejected under 35 USC 103(a) as being 
unpatentable over U,S. Patent No- 5,763,804 (Rigopulos) in view of U.S. 
Publication No. 2001/017415 (Hruska) and U.S, Patent No. 5,804,755 
(Furukawa). Office Action, 10 June 2005, pg. 20. 
Allowabilitv of Claim 30 

Regarding Claim 30, contrary to the Examiner's assertion, 
Rigopulos, Hruska and Furukawa fail to disclose or suggest an 

method for creating a polyphonic audio mix on a handheld mobile 
wireless communication device, comprising; 

playing a first soundtrack upon selecting the first soundtrack; 

selecting an audio characteristic for the selected fir^it soundtrack while 
playing the first soundtrack; 

playing the selected audio characteristic of the first soundtrack while 
playing the first soundtrack upon selecting the audio characteristic. 

Rigolopus does not play either the background track or the 
instrtmient track upon selection. In Rigolopus, the background track is 
selected in the setup stage (coL 8, lines 43-59) but not played until the joystick 
START button is depressed (col, 9, lines 33-39). After the setup is complete, 
the user selects an instrument. CoL 8, lines 66-67. In Rigopolus, however, 
music is not created using the instrument until the user depresses the PLAY 
button on the joystick. The Examiner relies on Hruska for teaching a handheld 
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mobile device having an audio mixer, but Hruska also fails to disclose or 
suggest the limitations discussed above. 

The Examiner's assertion that it would have been obvious to add 
features of Furukawa to Rigopolus "... to create a more unique playback 
track" is not supported by the art. Rigopolus discloses a device that enables 
users to play a selected instrument, using an input device, in the presence of a 
background track. There is no disclosure or suggestion in Rigopolus to create 
polyphonic playback tracks, Rigopolus selects a background track and then 
selects an insitrument track that is played using the input device. Rigopolus is 
unconcerned with creating polyphonic playback tracks. Claim 30 is thus 
patentably distinguished over the art. 

Allowability of Claim 31 

Regarding Claim 31 Rigopulos and Hruska fail to disclose or 
suggest in combination with Claim 30, 

... the first soundtrack is a reference soundtrack, selecting the first soundtrack 
from a plurality of different reference soundtracks, selecting a second 
soundtrack from a plurality of non-reference soundtracks while the reference 
sotmdtrack is playing, playing the second soundtrack upon selecting the 
second soundtrack white the reference soundtrack is playing. 

Rigolopus does not play either the backgrovind track or the instrument track 
upon selection. In Rigolopus, the background track is selected in the setup 
stage (col. 8, lines 43-59) but not played until the joystick START button is 
depressed (col. 9, lines 33-39). After the setup is complete, the user selects an 
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instrument. Col. 8, lines 66-67, In Rigopolus, however, music is not created 
using the instrument until the user depresses the PLAY button on the joystick- 
Claim 31 is thus patentably distinguished over the art 



Allowability of Claim 37 



Regarding Claim 37, contrary to the Examiner's assertion, 
Rigopulos, Hruska and Furukawa fail to disclose or suggest an 



... method for creating a polyphonic audio mix on a handheld mobile 
wireless conununication device/ comprising: 

playing a first soundtrack by selecting the soundtrack; 

selecting one of a second soundtrack and an audio characteristic of the 
first soundtrack while playing first soundtrack; 

if the second soundtrack is selected, playing the second soundtrack 
with tlie first sound upon selecting the second soundtrack wthout further 
input by user, 

if the audio characteristic is selected, playing the audio characteristic of 
the first soundtrack upon selecting the audio characteristic while playing the 
Brst soimd track without further input by user. 

Rigolopus does not play either the background track or the 
instrument track upon selection. In Rigolopus, the backgroxmd track is 
selected in the setup stage (col. 8, lines 43-59) but not played until the joystick 
START button is depressed (col. 9, lines 33-39)* After the setup is complete, 
the user selects an instrument. Col. 8, lines 66-67. In Rigopolus, however, 
music is not created using the instrument until the user depresses the PLAY 
button on the joystick. Thus, in Rigopolus, further input (i.e., depression of 
START and/ or PLAY) is required after selecting the background track and/ or 
the instrimient track. The Examiner relies on Hruska for teaching a handheld 
mobile device having an audio mixer, but Hruska also fails to disclose or 
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suggest the limitations discussed above. Claim 37 is thus patentably 
distinguished over the art. 

Prayer For Relief 



In view of the discussion above, the Claims of the present 
application are in condition for allowance. Kindly withdraw any rejections 
and objections and allow this application to issue as a United States Patent 
without further delay. 
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MOBILE WIREI:ESS COMMUNICATION HANDSET 
5 WITH SOUND MIXER AND METHODS THEREFOR 

FIELD OF THE DfSCLOSUREI NVENTIONS 

[OOOU The present disclosure i nv e ntions r elates generally to mobile 
10 wireless communication devices, and more particularly to handheld cellular 
conununication devices capable of mixing and playing polyphonic audio 
files and methods therefor. 



BACKGROUN D OF THE IN\^ENTIONS 

15 

[00021 Cellular handsets having sotmd mixers are known generally. 
In the P503i i-mode cellular telephone available from NTT DoCoMo, for 
example, the user must first select several soundtracks and then manually 
mix the selections. Particularly, in the P503i cellular telephone, the user first 

20 selects a music Category (Rock, Dance, Pops, etc*) soimdtrack and then first 
and second Backing Pattern soundtracks in corresponding menus displayed 
sequentially after each selection. In the P503 i cellular telephone, the selected 
soundtracks are mixed manually only after making all selections. Thus in 
the P503i cellular telephone, the user carmot listen to more than one selected 

25 soimdtrack at a time during the soundtrack selection process until after 
making all selections and manually mixing, since only individual 
soundtracks are played during the selection process. The P503i cellular 
telephone also permits the user to adjust the Kkey and ¥tempo of the mix. 
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but the s elected changes in these characteristics cannot be heard until after 
making the selections and manually mixing, 

[0003] The various aspects, features and advantages of the present 
5 invention disclosure will become more fully apparent to those having 
ordinary skill in the art upon careful consideration of the following Detailed 
Description of the Invention w ith the accompanying drawings described 
below. 

10 BRIEF DESCRIPTION OF THE DRAWINGS 

[0004] FIG. 1 is an exemplary mobile wireless communication handset 

[0005] FIG, 2 is an exemplary process flow diagram for implementing 

15 various aspects of the inventions, 

[0006] FIG. 3 is an exemplary soundtrack data set fUe stored on the 

handset 

20 [0007] FIG, 4 is an exemplary audio mix data reference file. 

DETAILED DESCRIPTIO N OF THE I^ A^^^TIO^f S 
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[0008]- FIG. 1 is a handheld mobile wireless communication device 
comprising generally a processor 10 and a DSP 12, memory 20, for example 
ROM, RAM, EEPROM, etc*^ a transmitter and receiver 30, inputs 40, for 
example^ a keypad and /or joystick, microphone etc., outputs 50 including 
5 an audio output and an output signal connector interface, and a display 60. 



[00091 The mobile wireless commimication handset may be? for 
example? a cellular telephone, personal digital assistant, one-way or two- 
way pager, or some other handheld mobile cornmunication device. 

10 

[00010] The invontii e ng are disclosure is drawn generally to methods for 
djmamicaJly creating polyphonic audio mixes on the— handheld mobile 
wireless communication devices, and generally to methods for creating and 
storing polyphonic mixes using e^ly^limited data storage resources on 
1 5 wireless communications handsets, and generally to methods for integrating 
audio data reference files and soimdtrack data files in the form of a 
polyphonic audio format file for uploading from wireless communications 
handsets, and combinations thereof. 



20 [00011] The invontion ! } arc disclosure is i mplemented generally in 

software on handheld mobile wireless commimication devices, including a 

polyphonic audio synthesizer softwar e program . In one embodiment, the 

audio synthesizer is a MIDI standard synthesizer, known by tho$e of 

ordinary skill in the art. In other embodiments, the synthesizer may be of 

25 another standard or a proprietary audio file synthesizer. The 

3 



PA(X SQffir RCVD AT mOS 5:42:03 PM [Eastern DayGgttf 



SEP-01-OT05 16:46 FROM : MOTOROLP PCS IPD 



18475232350 



TQ:USPTO 



P. 51^61 



''Mobile Wireless Communication Handset AppL No. 09/971^81 

With Sound Mixer and Methods Therefor" 
Atty, Docket No. CS90041 

implementation of audio S5aithesizers on cellular handsets is known 
generally as discussed above in the Background of the instant specification. 

[000121 The software is invoked by a user input command. In one 
5 embodiment, a polyphonic audio mix is created on a handheld mobile 
wireless conrunimication device by selecting a first sound track, and playing 
the first soundtrack upon selection thereof. In the presen t disclosure 
inventions , unless indicated otherwise, the playing of a soundtrack or sotmd 
effect of one or all of the sotmdtracks of the polyphonic mix occurs upon 
10 selection thereof, without additional input by the user. 

[000131 While *he-one soundtrack is playing, for example^ a^the-first 
selected soimdtrack, a subsequent or second soundtrack is selected and 
played along with the one or more prior selected soundtracks. Thus by 
15 selecting and playing each subsequently selected soimdtrack while one or 
more previously selected soundtracks are playing, the polyphonic audio 
mix is mixed dynamically as it is complied, which provides the user with an 
immediate indication of how the composition of the selected soundtracks 
will sound as the audio dxiring creation. 

20 

[00014] In one implementation, soundtracks are mixed by selecting and 

de^selecting combinations of soundtracks^ in any order ?. The selected 

soundtracks which are mixed dynamically upon selection and unmixed 

upon de-selection until the user complicG - compiles a satisfying combination 

25 of soundtracks, which may include different sotmd effects discussed more 

4 
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fully below. The compiled audio m ix may be saved or discarded upon 
completion of the selection exercise. 

[00015] In FIG. 2, a first soundtrack is played uf>on its selection at 2IO7- 
S tTlien^ ft-while the first soundtrack is playing^ a second soundtrack is played 
along with the first sound track upon selection of the second soundtrack at 
220, etc. The selected soundtracks may also be de^selected while playing 
upon ^ *p-re-selecting the same sound track afc 2IO7 . _fFor example^ the first 
soundtrack is played upon selection, wherein b y ro ii oloctin gr e-sclection of 
10 the first soundtrack will result in de-selection of the first sound tracka t-^lQ. 
The process of selecting and de^selecting soundtracks continues in no 
particular order until an appealing combinations combination of sounds are 
HEwtmixgd, whereupon the user may save the mix at block 230, as discussed 
more fully below. 

15 

[00016] According to the process Ulustrated in FIG. 2, several 
sotmdtracks may be mixed^^ _fPoT example^ a first soundtrack is selected and 
played, and then a second soundtracks is selected and played with the first 
sotmdtrack while the first soundtrack is playing?, and then a Additional 

20 dufd-soimd tracks may be 4 s-selected and played while the first and second 
soundtracks are playing, etc. .Any one or more of the selected soundtracks, 
for example^ the first soundtrack, may subsequently be subtracted from the 
mix, while the mix is playing, for example by de-selecting the first 
soundtrack. Alternatively, all of the selected soundtracks may be deselected 

25 simultaneously. 

5 
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[000171 In one embodiment, a first soundtrack is selected from a first 
plurality of soundtracks, and a second soundtrack is selected from a second 
plurality of soundtracks. Additional soundtracks may be combined, or 
3 mixed, with the first and second tracks, as desired. 

[00018] In one embodiment, at least one of ti\e soundtracks is a base, or 
reference, soundtrack selected from a plurality of different base 
soundtracks. In a preferred embodiment, the reference soundtrack is 
10 selected before selecting any other soundtracks. Thereafter, one or more 
soimdtracks are selected subsequently and mixed dynamically while the 
reference soundtrack and any other selected soundtracks are playing. Other 
embodiments are devoid of a base sotmdtrack. 

15 [00019] The plurality of different reference soundtrack s^ for oxamplo, 
may be characterized generally by corresponding rhythmic and harmonic 
characteristicsj, for oxamplcj thos e — Exemplary characteristics are those 
associated with Jazz, Rhythm & Blues, Soul, Rock, Latin, and Classical and 
Big Band, among other types of musi c, rospoctivoly . 

20 

[00020] Some of the soundtracks may be selected from a group of 
soundtracks having corresponding melodies. In one implementation, a 
melodic sotmdtrack is selected from a plurality of musical instrument 
instrum e nts s oundtracks, for example, from either a percussion, or a_wind, 
25 or a^stiing instrument sotmdtrack. In another embodiment, each melodic 
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sotmdtrack has corresponding variations. For example, upon selection of a 
"piano" soundtrack, there may be several piano soundtrack variation sub- 
selections among which to choose. 

5 [00021] In embodiments where there is a reference sotmdtrack, the 
instrument or melodic sotindtracks available for selection may be 
dependent upon, or specific to, the reference sotmdtrack selected. Where 
Rhythm & Blues is selected as the reference track, for example, the 
instrument soundtracks available may be piano, drum, bass and horn and 
10 corresponding variations thereof. Where the reference sotmdtrack is Rock, 
different instrument soundtracks and corresponding variations are 
available. 

[00022] In another embodiment, an audio characteristic or effect is 
15 selected for a selected soundtrack while playing the soundtrack. Exemplary 
sound effects include echo and reverberation, among others. De-selection of 
a sotmdtrack for which one or more effects have been selected, also de- 
selects the corresponding effects* 

20 [00023] The audio characteristic of the soundtrack is changed while the 

soundtrack is playing upon selecting the audio characteristic, thus 

providing the user with an immediate indication of how the selected 

characteristic affects the sotmdtrack as the polyphoruc file is created. After 

selecting a soundtrack, a sound characteristic, or effect, for the selected 

25 soundtrack is selected and played. Generally more than one glob<il effect 
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may be changed or selected. Selection and de-selection of effects are also 
illustrated in FIG. 2. 

[00024] In some embodiments/ a global audio characteristic common to 
5 all of the selected soundtracks is selected and played while playing the 
selected sound tracks^ thus changing the audio characteristic of all of the 
selected sotmdtracks while the soimdtracks are playing* Generally more 
than one global effect may be changed or selected, 

10 [00025] In some embodiments^ the number of soundtracks selected is 
limited, for example^ to 4 or 5 sotmdtracks?^ .flPor example^ the user may 
have the option of selecting one of three variations on as many as five 
different instruments. The user may also have the option of selection 1 or 2 
or more track-specific sound effects, and 1 or 2 or more global sound effects 

IS applicable to all tracks. 

[00026] Generally, the soundtracks and effects are made perceptible to a 
user of the handheld device, for example the soundtracks may be displayed 
or played audibly for selection by the user. In one embodiment, the 
20 soundtracks and effects are stored on the handheld device, and in another 
embodiment the soundtracks and effects are downloaded from some other 
location onto the device, either wirelessly or via a hardwired connection, by 
and upon selection thereof 

8 
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[00027] In another embodiment, the first sotmdtrack is selected to play 
for a first time interval^ and another soundtrack is selected to play for a 
second time interval different than the first time intervaL The time intervals 
of the soundtracks may be overlapping or separate. 

5 

[00028] In one embodiment, the sotmdtracks play the throughout the 
full interval of the audio mix, imless specified otherwise. In one 
embodiment, the time interval is determined when the soundtrack is 
selected relative to previously selected soundtracks already playing. Thus 
JO while one or more soundtracks play, the user may add an additional 
sotmdtrack by selecting the new soundtrack and after a time interval 
remove the new sotmdtrack by de::selecting (merely re-selecting) it. 

[00029] Upon selecting the soundtracks and any effectsj and 
15 corresponding time intervals, the audio mix is saved. In one embodiment, 
the newly created audio mixes are saved in an audio format file, for 
example^ the MIDI format audio file. The MTDI audio format has a time 
reference, with which start and stop times for corresponding sound h-acks 
may be associated. 

20 

[00030] FIG. 3 iUustrates an exemplary soxmdtrack data set file 300 that 
is stored on the handset in one embodiment of the disclosu r e invention . The 
exemplary data set includes a plurality of sets of instruments, or some other 
melodic? soundtracks, for example 310 and 320 in FIG. 3. In the exemplary 
25 embodiment each instniment or melodic soundtrack has three variations 
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312, 314 and 316, but more generally there may be more or less. Only one 
variation, variation 322, of the second plurality of instrument sets is 
illustrated, but generally there are more. The ii\strument9 tracks could 
instead be some other distinct melodic soundtrack and/or variations 
5 thereon. 

[00031] The exemplary soundtrack data set file 300 also includes a 
plurality of sound effect soundtracks 330 including an effect soundtrack 332, 
334 and 336 for a corresponding one of the sotmdtracks 312, 314 and 316, 
respectively. Each of the sound effect tracks 332, 334 and 336 may be, for 
example, a reverberation soundtrack. Alternatively^ there could be another 
set of effects, for example a corresponding echo track? (not Illustrated) for 
each of the soundtracks 312, 314 and 316- Generally, there are also, in some 
embodiments, corresponding effects soimdtracks for each of the other 
soundtracks 322, etc* In some embodiments, there are no effect soimdtracks. 
More generally, each soundtrack of the soundtrack data set file 300 in FIG, 3 
is a different soimdtracic 

[00032] The exemplary soimdtrack data set file 300 also includes a 

20 corresponding reference or base soundtrack 302. In one embodiment, there 

is a plurality of tmique soundtrack data set files each having a 

corresponding base track, e.g.. Jazz, Blues, Rock, Pop, etc., and 

corresponding instrument variation soundtracks stored on the handset. 

Additional soundtrack data set files m^y be downloaded onto the device, 

25 for example^ for a fee or as part of a subscription* 

10 
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[00033] In one embodiment, a polyphonic audio mix is created on the 
handset by entering reference data for corresponding soundtracks of a 
selected soundtrack data set file into an audio mix data reference file^, for 
5 example^ by selecting plural soundtracks at a user interface, as discussed 
above. The audio mix data reference file having soundtrack reference data 
is representative of the user defined polyphonic audio nux. In one 
embodiment^ the audio mix data reference file is not in an audio file format 

10 [00034] The audio mix data reference file having the reference data is 
stored on the handset as a distinct file, separately from the soundtrack data 
set files. The audio mix data reference file is itself preferably devoid of 
sotmdtrack data. Thus many audio mixes may be mixed and saved in the 
form of audio mix data reference files by the user without substantial 

15 memory usage, which is often limited on mobile commtmication handsets, 
since only the audio mix data reference file having the reference data is 
created and stored- In other embodiments, the audio mix data reference file 
includes copies of the soundtrack data, but this requires comparatively 
substantial memory for storage. 

20 

[00035] In FIG. 4, the audio mix data reference file 400 includes a file 
name field 410, one or more global sound file effect fields 420, for example 
Ttempo and /or Kkey, and a plurality of sotmdtrack fields 430, 432, 434, etc. 
In embodiments where a base track is desired, the audio mix data reference 
25 file includes a base track field 450. 

11 



PA(£ 5g%r RCVD AT 9/1/2005 5:42:03 PM [Eastern DayOght 



SEP-01-2005 16:48 FROM : MOTOROLA PCS IPD 



18475232350 



TOrUSPTD 



P. 59-^61 



"Mobile Wireless Communication Handset Appl. No. 09/971^381 

With Sound Mixer and Methods Therefor" 
Atty, Docket No. CS90041 



[00036] The file name field 410 stores file name data designated by ttie 
user for the corresponding user defined polyphoiuc audio file. The file 
name data may be entered by the user, for example upon completion of 
5 mixing the soundtrack. 

[00037] The global sound effect reference field 420 stores global efifect 
reference data, which is communicated to the synthesizer when the 
polyphonic audio mix is played. More than one global effect reference may 
10 be stored in the field 420, or alternatively multiple reference data fields may 
be provided for storing corresponding sound effect references. In one 
embodiment, the one or more sotmd effect fields provide the audio 
synthesizer with instructions for the sound effects that are to be played for 
the corresponding polyphonic audio mix. 

15 

[00038] The base track field 450 stores base track reference data, which 
references the base track, if zmy, associated with the corresponding 
polyphonic audio mix. In one embodiment, the base track field provides the 
audio synthesizer with iiistructions for which base track is to be played for 
20 the corresponding polyphonic audio mix* 

[000391 The soundtrack reference fields 430, 432, etc. store soxmdtrack 
reference data, which references corresponding soundtradcs associated with 
the corresponding polyphonic audio mix. In one embodiment the presence 

12 
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of particular soiindfcrack reference in the soundtrack fields indicates that the 
soundtrack has been selected, 

[00040] In some embodiments, time is associated with each of the 
5 soimdtrack reference fields. The time may, for example, be measured as a 
delay from the time that the polyphonic mix is initiated or played. Thus the 
soundtrack referenced in each field is played at the corresponding time 
associated therewith, A subsequent entry of a reference to the same 
soundtrack played previously may be used to toggle the soundtrack off. 
10 Thus the start and stop time for the soundtrack is entered as the soundtrack 
is selected and de-sdected. 

[00041] In other embodiment, the audio mix data reference file 400 has 
a reference field corresponding to each of the sotmd tracks and effects in a 

15 corresponding soundtrack data set file. Each field of the audio mix data 
reference file 400 also has an on/off code w hich that i s set or re-set upon 
selection of the corresponding sotmdtrack when the corresponding 
polyphonic mix is created. Thus, when it is desired to play the polyphonic 
mix, the audio mix data reference file 400 references only those soundtracks 

20 and effects that have been switched on for play by the audio synthesizer. 

[00042] According to another aspect of the d isclosure i iwontion . the 

audio mix data reference file 400 without soimdtrack data is integrated with 

a corresponding soundtrack data set file 300 into a common audio format 

25 file for uploading from the handset, for example to another user. 

13 
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[00043] In one embodiment, the integrated audio mix data reference 
and the soundtrack data set files are integrated irreversibly. Thus the 
recipient of the integrated audio file may listen to the audio file as mixed 
5 originally^ but cannot extract the soundtrack data set file 300 for making 
new audio files based on the soundtrack data set file. Providing the 
irreversibly integrated audio format file permits users to sample the 
associated soundtrack data set fQe, limited to the corresponding mix, 
without providing full access thereto. 

10 

[00044] While the present invontionQ disclosure and what is considered 
presently to be the best modes thereof have been described in a manner that 
establishes possession thereof by the inventors and that e nables those of 
ordinary skill in the art to make and use the same i nvontions , it will be 
15 understood and appreciated that there are many equivalents to the 
exemplary embodiments disclosed herein and that myriad modifications 
and variations may be made thereto without departing from the scope and 
spirit thereo f of the Inventions^ . Thus which are the invention is to be 
limited not by the exemplary embodiments but by the appended claims^ 

20 
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